Robust Emergent Activity in Dynamical Networks 
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We study the evolution of a random weighted network with complex nonlinear dynamics at each 
node, whose activity may cease as a result of interactions with other nodes. Starting from a knowl- 
edge of the micro-level behaviour at each node, we develop a macroscopic description of the system 
in terms of the statistical features of the subnetwork of active nodes. We find the asymptotic char- 
acteristics of this subnetwork to be remarkably robust: the size of the active set is independent of 
the total number of nodes in the network, and the average degree of the active nodes is independent 
of both the network size and its connectivity. These results suggest that very different networks 
evolve to active subnetworks with the same characteristic features. This has strong implications for 
dynamical networks observed in the natural world, notably the existence of a characteristic range 
of links per species across ecological systems. 
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PACS numbers: 05.45.-a, 89.75.Hc, 89.75.-k 

With the recent surge of interest in complex networks 
, the behaviour of dynamical units interacting on net- 
works has become a problem of crucial relevance to areas 
ranging from physics to biology to engineering. Coupled 
nonlinear systems, such as oscillators and maps, have 
been extensively investigated on regular lattices [2j • The 
graph theoretic aspects of random networks have also re- 
ceived considerable attention However, there have 
been very few studies on networks with nonlinear dy- 
namics at the nodes. Here we focus on this relatively 
unexplored area of random networks of nonlinear maps, 
and study the role played by the network properties on 
the time-evolution of the dynamical states of the nodes, 
in particular, and the global characteristics of the evolved 
network, in general. 

We consider networks with a wide range of (i) size 
(i.e., number of nodes, N), (ii) connectivity C between 
nodes (i.e., the density of links), (in) measure of interac- 
tion strength a that determines the weights of the con- 
nections (i.e., how strongly the nodes are coupled) and 
(iv) local dynamics at the nodes (ranging from regular to 
chaotic) . The important feature here is that even though 
the isolated nodes may exhibit a wide range of activity, 
the network yields generically chaotic global dynamics. 
This can result in a fraction of the nodes being driven to 
a state of null activity, implying that under interactions 
a certain set of nodes show a transition from persistent 
to transient activity. In this paper, we examine the prop- 
erties of the subnetwork of nodes with persistent activity. 
We show that the size of this subnetwork of active nodes 
is remarkably independent of the network size. Further, 
the total number of links in this subnetwork is indepen- 
dent of both the size and the connectivity of the network. 
These results have considerable significance for the ob- 
servable properties of networks occurring in nature. 

The work reported in this paper can be seen in the 
context of deriving a statistical mechanics of interacting 
dynamical elements Starting from a micro- level dy- 

namical description, where the relevant variables are the 



local states of each node in the network, we would like to 
achieve a macroscopic description of the system in terms 
of the number of active nodes, and would like to under- 
stand how such macro- variables are determined by over- 
all network properties, such as, N, C and er. One would 
have naively supposed that the macroscopic system vari- 
able of interest, namely, the size of the persistently active 
subnetwork, would be an extensive quantity. However, 
our results show that this macroscopic quantity does not 
scale with system size. This implies the existence of "uni- 
versal" relations between various gross network proper- 
ties in the asymptotic state, and the emergence of char- 
acteristic robust features independent of network size. 

Our model is quite general: it has N dynamical ele- 
ments in a network with random nonlocal connectivity. 
The dynamical state of each node i(= 1 . . . N) at time n 
is associated with a continuous variable Xi(n), which is 
the microscopic variable of interest in the system. The 
interaction between two nodes is given by a coupling co- 
efficient Jij. We consider the most general case where 
these coefficients can be asymmetric ( Jij ^ Jji) and can 
be either positive or negative. The time-evolution of the 
system is given by 



Xi(n + 1) = f[xi(n){l + YtjJijXjtn)}}, 



(1) 



where / represents the local on-site dynamics. In this 
paper we have shown representative results for / chosen 
to be the exponential map, 



a r(l-x) 



if x > 0; 



0, otherwise, 



(2) 



r being the nonlinearity parameter leading from periodic 
behaviour to chaos [(| . This belongs to the class of maps 
defined over the semi-infinite interval [0, oo] rather than 
a finite, bounded interval (e.g., as is the case for logistic 
map). This allows us to explore arbitrary distributions 
of couplings between nodes, unlike maps bounded in an 
interval, which are well-behaved only for restrictive cou- 
pling schemes. In addition, in our case, the nonlinearity 



FIG. 1: The initial (left) and asymptotic (right) state of a 
network with N = 100, C = 0.1, a = 0.1, r = 4. Only 
the connections between active nodes are shown. Solid lines 
represent positive links, while broken lines represent negative 
links. 

parameter r is not artificially restricted by the domain of 
definition of the map. All these features increase the gen- 
erality of our results, and additionally, such maps provide 
a more accurate description of natural processes, e.g., 
population dynamics 0, § • 

The connectivity matrix J = {Jij} is, in general, a 
sparse matrix, with probability 1 — C that an element 
is zero. The diagonal entries Ju = indicate that in 
the absence of interactions, the local nonlinear map (2) 
completely determines the dynamical state of each node. 
The non-zero entries in the matrix are chosen from a 
normal distribution with mean and variance a 2 . Note 
that we have also used uniform distributions over the 
interval [— <j, a] without any qualitative changes in the 
results. 

Initially, the states of all the N nodes are randomly 
distributed about x = 1. During the evolution of the 
network, if the state of a node becomes x < 0, it stops 
being active and subsequently has no interaction with the 
rest of the network. Note that, in the absence of coupling, 
the maps describing the dynamics at individual nodes do 
not cease activity. This allows us to focus on the insta- 
bility induced by network interactions, rather than the 
intrinsic behaviour of the nodes. As a result of these 
interactions, the number of persistent nodes (i.e., with 
x > 0) decreases rapidly from the initial value, but even- 
tually attains a steady state. This is because, at the ini- 
tial stages, the population of each node undergoes strong 
fluctuations due to interaction with other nodes coupled 
to it, resulting in the cessation of activity of a large num- 
ber of nodes. Within a very short time, the effective 
number of interacting nodes decrease and, consequently, 
the intensity of such fluctuations is also reduced. We 
have continued the simulations for up to 10 4 iterations, 
when the probability of further extinctions was found to 
become extremely small. We then look at the number of 
nodes which survive with persistent activity as a function 
of the model parameters (Fig. 1). 

The number of nodes with persistent activity is a mea- 
sure of the global stability of the network. The infor- 
mation that we get from this is very different from the 
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FIG. 2: Time-evolution of the number of active nodes for 
networks of various sizes N (C = 1, a — 0.1 , r = 4), showing 
the rapid decay to the asymptotic value that is independent of 
N. (Inset) The asymptotic number of active nodes, N ac u ve , 
as a function of network size N (□: C = 0.1, a = 0.1, r = 4; 
A: C = 1, a = 0.1, r = 2; o: C = 0.1, a = 0.5, r = 4; o: 
C — 1, a — 0.1, r = 4). Note that, in all cases, N ac tive is 
independent of the network size N, for large N. 

local stability and complementary to it. Note that, in 
the study of interdisciplinary problems, global stability 
(or persistence) is often much more relevant than the 
more commonly used measures of local stability. For ex- 
ample, networks susceptible to catastrophic failures or 
crashes are extremely common in the real world. In such 
problems, the quantity of interest is the system's global 
stability, as reflected in the survival probability of nodal 
activity, rather than local stability, which, in the absence 
of regular equilibria, does not contribute to our under- 
standing of the overall system dynamics . 

We now look at the features of the asymptotic subnet- 
work consisting of the nodes which survive with persis- 
tent activity. The first significant feature of this emergent 
subnetwork is that its size is independent of the system 
size N. This is clearly evident from Fig. 2, which shows 
that the size of the active subnetwork quickly approaches 
its asymptotic value N act i ve which is a constant with re- 
spect to N (within error bars). For example, for the 
representative case ofcr = 0.1,C=l,r = 4, we find that 
Nacuve = 7.705 ±1.260 for N = 250, while for N = 1000, 
N active = 7.835 ±1.247. 

In the absence of connections (C = 0), N act i ve (= N) is 
obviously extensive. But for C > 0, N act i ve saturates to 
a value independent of N . This non-extensivity for the 
active subnetwork has significant implications. For in- 
stance, let us consider two stable networks, each of which 
has N ac ti V e persistently active nodes. On being joined to- 
gether (analogous to two distinct ecological systems being 
suddenly linked to one another), the merger initially re- 
sults in a high number of active nodes, which is essentially 
the sum of the active nodes of the two components (= 
2N act i ve ). However, the new connections prompt a fresh 
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FIG. 3: Asymptotic number of links per node in the active 
subnetwork (k a ctive) as a function of the number of links per 
node of the full network (ko) for different values of a (C — 
1, r = 4). The broken line represents kactive = &o- The inset 
shows kactive as a function of a for N = 100 and 1000. Note 
that the two data sets converge at a high value of a and match 
well with the broken line representing ~ I/a. 

wave of extinctions to occur, resulting in the number of 
active nodes rapidly settling back to the characteristic 
value N acUve . 

Another remarkable feature is that the average number 
of links per node in the active subnetwork, k act i ve , is inde- 
pendent of N , as well as C. Therefore, k act i ve is indepen- 
dent of ko(= AC), the average degree of the entire net- 
work (Fig. 3). The significance of this result is evident: 
regardless of the size and connectivity of the network, the 
nodes in the active subnetwork has a characteristic num- 
ber of links. Together with the earlier result of a char- 
acteristic size for the active subnetwork (N act i ve ), this 
implies that the total number of links (N ac tive x kactive) 
connecting the active nodes is a robust quantity. 

The active subnetwork is further characterised by dis- 
assortativity, i.e., nodes with high degree connect prefer- 
entially to nodes having fewer links, a feature observed 
in many biological and technological networks. For in- 
stance, the disassortativity index as defined by Newman 
[13 is -0.11 for N = 100, C = 0.5, a = 0.1, r = 4. 

The fact that the size of the active set is independent 
of the network size N may be naively expected from the 
May-Wigner stability criterion According to this, a 
system is critically stable if NCa 2 ~ 1. So the size of 
the asymptotically stable set N ac tive is proportional to 
1/Ca 2 . However, note that, in an evolving system, the 
values of C and a for the active set also change signifi- 
cantly over time, with nodes becoming inactive and their 
links becoming non- functional. As a result, we have an 
interplay between the size and structure of the subnet- 
work of active nodes: the size of this set changes due to 
the stability criterion involving the structural parameters 
C and a at that point in time, while the latter (C , a) 
themselves change due to the reduction in the number 
of active nodes. For the May-Wigner argument to hold, 



FIG. 4: The persistence probability (i.e., survival of activity) 
of individual nodes as a function of the fraction of negative 
links to that node, appropriately scaled by the network size 
N, so that data for different values of N (A: N — 250, o: 
N — 100, X: N — 50) collapse on the same curve using = 
0.1 for N = 50, = 0.06 for N = 100 and = 0.039 for N = 250. 
The network parameters are C = 0.1, a = 0.1 and r = 4. The 
inset shows the connectivity of the active subnetwork, C 'active, 
as a function of C for two different network sizes. 

it is crucial that C and a eventually attain their own 
asymptotic values C 'active and <j active, and that these are 
independent of network size N . To verify this we now 
look at these properties in the asymptotic set of active 
nodes. 

First, we examine how the effective connectivities of 
the asymptotic subnetwork, C active, is different from the 
network connectivity, C. Remarkably, C ac tive is found 
to be independent of the network size for large N. For 
< C < 1, the effective connectivity of the asymptotic 
subnetwork shows a clear trend of evolving to a slightly 
lower value compared to C [Fig. 4 (inset)], with the 
deviation increasing with average interaction strength, a 
and local nonlinearity parameter, r. The independence 
of Cactive from A^ can also be inferred from Fig. 3, by 
noting that the kactive v s fco curve can be constructed 
entirely by considering C — 1, for which C ac tive(= C) is 
obviously independent of A\ The same curve holds for 
other values of C and therefore one can conclude that 
Cactive is independent of A, for all C. Further, N ac tive ~ 
^/Cactive which is consistent with our earlier result 
that Nactive is independent of N. 

Next, we address the question of the independence of 
^active with respect to N , by looking at the distribu- 
tion of the connection weights Jij of the persistent nodes. 
Specifically, we examine how this differs from the distri- 
bution of in the full network. We observe that starting 
from a Gaussian distribution (for instance), the distribu- 
tion that emerges is independent of N, indicating that 
^active is independent of the network size. Further, the 
distribution is markedly skewed towards positive weights 
implying a selective tendency of nodes with high nega- 
tive links to be eliminated. This is consistent with the 
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FIG. 5: Distribution of the (non-zero) interaction strengths 
Jij between active nodes of a network for C = 0.5, a = 0.1 
(solid line), C = 1, a = 0.1 (dashed line) and C = 0.5, a = 0.2 
(dotted line). Note that, the cutoff at the lower end, J*, is 
independent of a. The inset shows the Jij distribution in the 
full network for the same set of parameters. 

probability of survival of a single node being a decreasing 
function of the relative number of its negative links (Fig. 
4). 

To explain the numerical results that show the average 
degree of the active subnetwork, k ac tive, evolving to a 
characteristic value, we recall that the average number 
of links per node is given by the product of N ac tive and 
C active- The C 'active does not vary too much from C, but 
Nactive varies significantly from N. So, the number of 
links essentially is dependent only on N ac tive- If N ac tive 
settles down to the same constant value independent of 
N, it implies that the number of links is also a robust 
quantity (Fig. 3). 

Further, k ac tive varies with the overall network aver- 
age interaction strength as ~ 1/cr [Fig. 3 (inset)]. This 
can be understood from the condition determining persis- 
tence of activity for an individual node i; P(J2j Jij x j < 
— 1). Note that, the contributing terms in the sum are 
due to active nodes which have outgoing links (with non- 
zero weights) to node i, i.e., the degree of the node in the 
active subnetwork. From Fig. \5\ it is apparent that the 
asymptotic distribution of Jij for the set of active nodes 
has a positive mean, jjL. This implies that the quantity 
Y) j JijXj has a standard deviation, which is dominated 
by the leading term, ^k act ive, implying k ac uve ~ 
To see how \i is related to a, we look in detail at the 
asymptotic distribution of Jy. It is immediately appar- 
ent that the dominant change in the asymptotic distribu- 
tion, vis-a-vis the original distribution is the loss of the 
strong negative links. This results in the final distribu- 
tion being truncated at the negative end, with the cutoff 
J* apparently independent of a (Fig.JSJ. Assuming that 
the positive part of the distribution is almost unchanged 



from its original form, we see that fj, — J™ JijP(Jij) es- 
sentially goes as a, as the shift of the mean from zero is 
entirely determined by the width of the original distribu- 
tion. 

In conclusion, we have shown that a very simple model, 
with very few assumptions regarding the node properties 
and their dynamics, yields surprisingly robust macro- 
scopic features of the emergent active system: (a) the 
asymptotic number of active nodes is independent of the 
network size, and (b) the asymptotic number of links be- 
tween the active nodes is independent of both the size of 
the network and its connectivity. The link removal pro- 
cess is not guided here by any explicit criterion designed 
to achieve a desired end-state but emerges naturally from 
the dynamics at the nodes. 

The observed non-extensivity of the active subnetwork 
indicates that designing robust structures simply by in- 
creasing the redundancy of nodes, keeping the connec- 
tivity and interaction strength distribution unchanged, 
is not a good strategy, as the number of asymptotically 
active nodes is independent of the initial number of nodes 
that one starts out with. This provides an explanation for 
similar observations in natural and artificial complex sys- 
tems, such as the conservation of the number of species 
in an ecosystem after major extinctions (e.g., after the 
eruption in Krakatoa) or migrations (e.g ., after the link- 
ing of North and South America) [l2|, as well as the 
existence of a characteristic range of links per species (3 
to 5) across different environments [l3j . 
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